RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects
نویسندگان
چکیده
We present RGB-D-Fusion, a multi-modal conditional denoising diffusion probabilistic model to generate high resolution depth maps from low-resolution monocular RGB images of humanoid subjects. RGB-D-Fusion first generates map using an image conditioned and then upsamples the second on RGB-D image. further introduce novel augmentation technique, noise augmentation, increase robustness our super-resolution model.
منابع مشابه
Deep Depth Completion of a Single RGB-D Image
The goal of our work is to complete the depth channel of an RGB-D image. Commodity-grade depth cameras often fail to sense depth for shiny, bright, transparent, and distant surfaces. To address this problem, we train a deep network that takes an RGB image as input and predicts dense surface normals and occlusion boundaries. Those predictions are then combined with raw depth observations provide...
متن کاملKinect-based Real-time Rgb-d Image Fusion Method
3D reconstruction of indoor environments based on vision has been developed vigorously. However, the algorithm’s complexity and requirements of professional knowledge make it restricted in practical application. With the proposition of the concept of Volunteered Geographic Information (VGI), the traditional method is no longer suitable for VGI. So in this work we utilize consumer depth cameras ...
متن کاملShape Preserving RGB-D Depth Map Restoration
The RGB-D cameras have enjoined a great popularity these years. However, the quality of the depth maps obtained by such cameras is far from perfect. In this paper, we propose a framework for shape preserving depth map restoration for RGB-D cameras. The quality of the depth map is improved from three aspects: 1) the proposed region adaptive bilateral filter (RA-BF) smooths the depth noise across...
متن کاملDepth-aware CNN for RGB-D Segmentation
Convolutional neural networks (CNN) are limited by the lack of capability to handle geometric information due to the fixed grid kernel structure. The availability of depth data enables progress in RGB-D semantic segmentation with CNNs. State-of-the-art methods either use depth as additional images or process spatial information in 3D volumes or point clouds. These methods suffer from high compu...
متن کاملRGB-D depth-map restoration using smooth depth neighborhood supports
A method to restore the depth map of an RGB-D image using smooth depth neighborhood (SDN) supports is presented. The SDN supports are computed based on the corresponding color image of the depth map. Compared with the most widely used square supports, the proposed SDN supports can well-capture the local structure of the object. Only pixels with similar depth values are allowed to be included in...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3312017